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Abstract 

This paper considers the problem of uniqueness of the solutions to a class of Marko- 
vian backward stochastic differential equations (BSDEs) which are also connected to 
certain nonlinear partial differential equation (PDE) through a probabilistic represen- 
tation. Assuming that there is a solution to the BSDE or to the corresponding PDE, 
we use the probabilistic interpretation to show the uniqueness of the solutions, and 
provide an exampleof a stochastic control application. 
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1. Introduction 

In this paper, we study a class of decoupled forward-backward stochastic differential equa- 
tions (FBSDEs) which have a Markovian structure of the following form: 

dX{t) = fi{t,X{t))dt + a{t,X{t))dW{t), <t <T 

dY{t) = -F{t,X{t),Y{t),Z{t))dt + Z{t)dW{t), <t <T (1) 
X(0) = xo; Y{T) = g{X{T)) 

where the forward process X has a unique solution in a probability space F,P), the 
random variable Y{T) = g{X{T)) is integrable and the driver of the backward process Y, 
F(t, X, y, z), is quadratic in z. Due to such a growth condition on z, these BSDEs are called 
quadratic BSDEs or "BSDEs with quadratic growth" in the literature. Moreover, due to the 
Markovian nature of formulation, the FBSDEs of the form ([1]) are known to be related to 
certain quasilinear parabolic partial differential equations (PDEs). 

After the first existence-uniqueness result for nonlinear BSDEs with Lipshitz coefficients 
was given by Pardoux and Peng (1990), FBSDEs and especially Markovian BSDEs have ap- 
peared in many application areas including mathematical finance, stochastic optimal control 
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and analysis of nonlinear PDEs. The existence-uniqueness results for more general BSDEs 
were provided by Mao (1995), Lepeltier and San Martin (1997, 1998), Kobylanski (2000), 
Briand et. al (2007), Briand and Hu (2006, 2008) and Fan and Jiang (2010), among others. 
Their connections with quasihnear PDE's were first stated by Pardoux and Peng (1992), and 
Peng (1992) by generalising the Fcynman-Kac representation of PDE's. They also provided 
a uniqueness result when the coefficients involved were uniformly Lipshitz. Similar results 
and their connections with the stochastic control problems were also reported in El Karoui 
et al (1997), Ma and Yong (1999), Cetin (2005), Fuhrman et. al (2006) and Richou (2011). 

The existence results for the quadratic BSDEs usually assume strong growth, monotonic- 
ity, convexity/concavity or boundedness conditions on the driver or on the terminal value. 
The issue of uniqueness is much more complicated and usually requires stronger assumptions 
or some specific forms of the parameters. See Briand et. al (2007), Fan and Jiang (2010) 
and Richou (2011) for a discussion of such special cases, and the other works in the htera- 
ture. Our aim is to obtain the uniqueness results for a class of the Markovian BSDEs with 
quadratic growth where the solution Y is bounded from below only. Such equations usually 
appear in the stochastic control problems, where the process Y would yield the value func- 
tion of a minimization problem over a suitable space of admissible controls. An application 
to perturbed linear-quadratic regulator (LQR) problem is provided in the last section. 

The rest of the paper is organized as follows: The basic definitions and the notations of 
the paper are introduced in the subsection 1.1 below. A uniqueness result for solutions to a 
class of Markovian BSDEs is given in the section 2. The section 3 describes how such BSDEs 
can be used to study the properties of the solutions to some certain quasihnear PDEs which 
are also related to the stochastic optimal control problems where only the drift term of the 
state process is control-dependent. 

1.1 Definitions and Notations 

For simphcity, we consider the one-dimensional Euchdean space R even though most of the 
results hold for higher dimensions. For a given T > and a probabihty space (Q, F, -P) 
where F — {F t : < t < T} is the complete cr— algebra generated by a standard Brownian 
motion process W, we define the following spaces: 

• C^'^([0, T]): The space of all real- valued measurable functions / : [0,T] x R such 
that f{t, x) is p (respectively, q) times continuously differentiable with respect to t 
(respectively, x) where p, q are non-negative integers. 

• Lp^(Q): The space of FT-measurable random variables H such that < oo. 

• L'^^{fl): The space of F t- measurable essentially bounded random variables. 

T 

• Lp([0,T]): The space of F -adapted processes / such that E[J \ f{t)fdt] < oo. 



• L^([0,T]): The space of F- adapted essentially bounded processes. 

• Sfr{[0,T]): The space of F -adapted processes such that E[ sup |/(t)|^] < oo. 

0<t<T 
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The notation Et[.] will denote the conditional expectation When the initial value 

of a process X is given at time t, then refers to E[.] with = x. For a deterministic 

function h{t, x) : [0, T] xM ^ R, the subscript notation denotes partial derivatives: ht{t, x) = 
^(t, x), hx{t,x) = |^(t, x) and hxxit,x) = ^{t,x). In particular, for functions or ODE's 
of one variable t, dot (') designates the derivative with respect to t. For a function v G 
C^'^([0,T] X M), let L denote the backward evolution operator associated with the forward 
diffusion process X in ([1]): 

lv{s,x) = Vs{s,x) + ^{s,x)vx{s,x) + ^a^Vxx{s,x). (2) 
Then consider the PDE 

Lv{t,x) + F(t,x,v,aVx) = (3) 
v{T,x) = g{x). 

If 3 c > such that a{t, x) > c for all {t, x) G [0, T] x M, then the PDE (I3l) is called uniformly 
parabolic. Such PDEs are known to have unique classical or generalized (e.g. viscocity) 
solutions under certain regularity and growth conditions. When a PDE is associated with a 
stochastic control problem in the form of Hamilton- Jacobi-Bellman (HJB in short) PDE, a 
"guess" solution to the HJB PDE usually turns out to be the solution to the corresponding 
control problem, thanks to the availability of a relevant verification theorem. For a summary 
of known results and the assumptions on such verification theorems, see Fleming and Soner 
(2006, IV. 4) or Yong and Zhou (1999). A verification theorem is often stated heuristically in 
applications to conclude that the solution to the control problem is also the unique solution 
to the corresponding PDE, in a suitable space of continuous functions. In this paper, our 
emphasis is on a probabilistic description and interpretation of such equations. 



2. A Uniqueness Result for a Class of Markovian BSDEs 

In this section, we first assume that the BSDE in ([T]) has a solution {Y, Z) in S]p^ x L\ in 
a probability space {fl,r,P)- Even though an interpretation of the weak solutions of the 
state variable X is relevant in the PDE formulation, we are going to stick to the strong 
existence- uniqueness in the reference space {Q,r,P), for the simpliciy of the presentation. 
The following result which is a special case of the Bihari's inequality will be useful in the 
specification of the assumptions and the proof of our main result. For a more general version, 
one can refer to Bihari (1956) or Mao (1995). 

Lemma 1 (Bihari's inequality) ForT > 0, let f{t) and v{t) be two continuous functions 

on [0, T]. Moreover, let k, : [0, oo) — i- [0, oo) be a continuous and nondecreasing function such 

t 

that k{x) >0forx>0and j ^ = oo. If f{t) < j v{s)K{f{s))ds for all t G [0,T], then 

0+ 

f{t) = for allte [0,T]. 
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Now, for {t,x) G [0,T) x R, we consider the following form of the driver in ([T]): 

F{t, X, y, z) = fit, x) + h{t, x)z - X{t, y) - ^H{t)z\ (4) 

where the real-valued continuous functions /, h and A on [0,T] x M, and i7 : [0,T] — )■ M are 
continuous. The motivation for the choice of such a driver comes from the stochastic optimal 
control applications where the control process appears only in the drift term. Here, the driver 
function F may neither be Lipshitz with respect to any of the variables, nor have a linear 
growth in any of them. Moreover, we neither impose any convexity /concavity assumption 
on / or A, nor an exponential moment condition on the terminal condition g or /(t, xjj. To 
the best of our knowledge, no existence or uniqueness result is known to cover the BSDEs 
with such general drivers even though some special cases were considered in Cetin (2005), 
Briand et. al (2007), Briand and Hu (2008) and Richou (2011). 

Condition 1 (i) H is a positive and continuously differentiable function which is bounded 
away from zero. 

(a) fit,x) > on [0,T] X M, and satisfies fit,X) G Lp where X is as in (QP and . 
(Hi) the function A is such that 

2\u-v\- \u\{t,M -\nu/H{t)) -v\{t,M -lnv/H{t))\ < ip{t).K{\u - vf), (5) 

for < t < T and < u,v < 1, where the function k, satisfies the conditions given in 
Lemma [I] and ip is a continuous function. 

(iv) the terminal condition g{x) is bounded from below such that giX^) G L]p^. 

(v) h(t,x) is bounded on [0,T] x R 

(v/ there is a constant 7 G (0, 1) such that 2H(t)f(t, x) — M££il > g, uniformly on [0, T] x M 
and h{t,X) G Lj,. 

We now state a technical lemma that will be needed in the proof of the main result of 
the paper. 



Lemma 2 Let 0<r<l, 0<e<e ^ and define a function /t^'^(.) as 

_ ( x(ln(x-l))^ < X < e 

\ K'^'{e) + k'''{e){x-e), x>e 

where ik,^''^{e) = lim k^'^{x). Then k^'''(.) is an increasing, non-negative and concave (differ- 

entiable) function satisfying 
(i) lim K'^'^^ix) = 0. 

(a) For all < r < 1 and < e < e^^, 3ei G (0,6^"'^) such that k,'^'^{.) < k'^1'^(.), uniformly 
in X. 

(Hi) there exists a constantC = C(e, r) > such that \x — y\ \k,'^'^{x) — K'^'^{y)\ < Ck'^'''"{\x — yf), 

^Exponential moment conditions are too strong for many interesting FBSDEs where the terminal condi- 
tion depends on an exponential martingale process, as in the mathematical finance applications 
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for all x,y m(0, 1]. In particular, |x — ?/| — < Ci\x — yf ln{\x — y\ ^) also 

holds, with Ci < C{e,r). 

(^^) I 1^7y{x)^^ = oo, for <r <1. 



0+ 



Proof. For simplicity, we write k = k"^'^. Note that k{x) describes a line with a positive 
slope k{e) = [ln(e~^)]^{l — r/ ln(e~^)} for a; > e. It is straightforward to see that k{x) > for 
X < e, k{x) < for X > 0. Hence k{.) is a (strictly) increasing concave function and the result 
lim k'^'^{x) = in part (i) is a straightforward application of L'Hopital's rule. Moreover, for 

x—^0+ 

fixed r, the expression (ln(a;~^))^ is strictly increasing in p for < x < e < and r < p < 1. 
So, the strict inequality < k'^^'^{x) in (ii) holds for all < x < ei = e < e^^. To 

ensure this inequality is also valid for larger x and e values, let < e < e~^'. Since k^'^{-) is 
a decreasing function, we have 1 — r = k^''^{e^^) > k^'^'{e). Then we can select ei such that 
k'^^'^{ei) > 1 — r. For example, < ei < e*"^^ < will do it, proving the part (ii). 

To show (iii), without loss of generality, assume that < x < y < 1 and let d = y — x > 0. 
For X > e, we have K{y) — k(x) = dk{e), where ^(e) < Jln(e~"'^)]'' < C[ln((i~^)]'', with 
C = max{l, ( 2i!r(i-e) )''}' depending on whether d'^ > e holds o So, 

d l^iy) - k{x)\ < Cd^[ln{d-^)Y = CK'''{d^). 

For X < e, since d < y, there are two other possible cases, namely, d"^ < x < y or x < d"^ < y. 
When d"^ < X < y, hj mean value theorem, K{y) — k{x) = dk{z), for some z between x 
and mm{y, e}. But since k{.) is strictly decreasing on (0, e] and d'^ < x < z, we obtain 
K{y) — k(x) < dk{d'^) < d[\n{d~'^)Y . For the case x < d"^ < y, hj adding and subtracting 
x[\n{y^^)Y to K{y) — k(x), we get < K{y) — k,{x) = d[\n{y~^)Y + x{[\n{y~^)Y — [ln(x^-'^)]''}, 
where ln(y^^) < ln((i^^) < ln(x^^). Then the inequality 

K{y) - k[x) < d[ln{y-^)Y < d[ln{d-^)Y 

easily follows, and hence, when x < e, (iii) holds with C = 1, . Moreover, by part (ii), 
3ei G (0,e~"^) such that n'^'^ {\x — yf) < n'^^'^{\x — yf) and hence the result follows for all 
r G (0,1]. The part (iv) is simply a result of part (ii): 3ei G (0,e~^) such that, for all 
0<r<l,5>0 and < e < e"'', 

(5 5 min{<5,ei) 

dx ^ r dx ^ r —dx 
K^'^(x) ~ J fi;^i'^(x) ~ J xln(x) 





Theorem 2 For T > and p > 1, let the SDE in (Q]) have a unique solution X in L^[0, T] 
with a.s. continuous paths. Moreover, let the assumptions (i)-(iv), and (v) or (v)' of Condi- 
tion 1 hold for the BSDE with driver F{t,x,y, z) as in Q). Then the BSDE [W\) has 
at most one solution {Y, Z) in Sp^ x L'^ such that Y is bounded from below. 



^Since the expression {j^^^zr^Y is increasing in r and decreasing in e, by choosing e ~ e for each r, C 
can be selected to be hm „/"/.'^-' ^ = 1. 090 1. 
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Proof. If the pair {Y, Z) is such a solution, let M be a lower bound for Y and consider 
the exponential transformation U{t) = exp{—H{t).{Y{t) — M)), for t G [0,T]. Clearly, U{.) 
is bounded a.s. (between and 1) and Y{t) = M — \nU(t)/H(t) can be uniquely recovered 
from U (t). The same idea applies to any solution [Y' , Z') to the equation fT^) . and hence the 
problem reduces to showing the uniqueness of the solutions to the BSDE for the transformed 
process U{.). For simplicity of the notation, we take M = 0. By Ito's rule and (j4]), a pair 
(f/. A) with A{t) ^ -H{t)UZ(t) and U{t) = exp{-H{t).Y{t)) satisfies the nonlinear BSDE 

dUit) = {^lnU- HXit, + Hfit, X) - M!l^}f/(t)dt + A{t)dWit) (7) 

H H U 

with the terminal condition U{T) = exp{—g{X{T))) and < f/(.) < 1 a.s. on [0,T]. 

Now, let ([/i,Ai) and {U2,A2) be two (bounded) solutions to the BSDE Then, by 

applying the Ito's rule to {Ui — U2Y ^"^^ rearranging the terms, P-a.s, the expression 

T T 

\Ui{t)-U2{t)\^ + j{Ai-k2)\s)ds + j 2H{s)f{s,X){Ui-U2)\s)ds (8) 
t t 

can be written as 

T T 

- j 2{U,-U2)iAi-A2){s)dW{s)- j[2^{U^-U2){U^\nU^-U2\nU2){s)]ds (9) 
t t 

T T 

+ j 2i/([/i-[/2)[f/iA(s,^^)-f/2A(s,^^)](s)rfs + j 2h{s,X){A,-A2){U,-U2){s)ds, 



t 



T 



a.s. for < t < T. Note that the integral / 2H{s) f{s, X{s)){Ui - U2){s)fds in ^ is 

t 

non-negative a.s. by the positivity assumptions on H and /, implying that both ^ and ^ 
are non-negative. In the first integral is a martingale, and by Lemma [2] with r = 1 and 
e being sufficiently close to e~^, the expression {Ui — f/2)(?7i In f/i — f/2lnf/2) in the second 
integral satisfies 

\Ui - U2\ \Ui\nUi - f/2lnf/2(.)| < Ck^'WUi - U2f (.)). 
Moreover, thanks to the assumption Ij^ for A, the third integral of ([^j is bounded by 

T 

J H{s) \if{s)\ K,{\Ui{s) — U2{s)\ )ds, for some function k, as in Lemma [1] Finally, let the 



t 



assumption (v) of Condition 1 hold and K be an upper bound for \h{t,x)\. Then, applying 
the inequality 2 \ab\ < 70^ + 6^/7 to the integrand of the last term of ^ with 7 = 2K, we 

get 



T 



t 



T 



J 2/i(s,X)(Ai-A2)(f/i-f/2)(s)c/s < K J 2|(Ai-A2)(f/i-f/2)|(s)rfs 



t 

T T 

< ^ f \Ai~A2fds + 2K^ f \U1-U2fds. 
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Therefore, taking the expected value of both ^ and and combining with the terms 

above, the following upper bound for - f/sl^ (t) + / ^^i^^^rfs] is obtained: 

t 

T . T T 

2CE j ^ te'WUi-U2\^){s)ds + E j \^\HK{\Ui-U2\\s)ds + 2K'^E j \Ui - U2\^ {s)ds 
t t t 

T T 

which is further bounded hj E j v^{\Ui — ){s)ds+2K'^ J E \Ui — U2\ {s)ds where ^{x) = 



t 



+ k{x) is concave and v{t) = ma,x{H(f{t),2C ^{t) 
the Lemma [H Now, these bounds imply, in particular, that 



satisfying the assumptions of 



1 1 

E \U,{t) - U2{t)f <E[j v{s)i{\U^{s) - U2{sf)ds + 2K^ J E \Ui{s) - U2{s)f , 

t t 

and hence by an appeal to the Gronwall's and Jensen's inequalities, we deduce 

T T 

E |f/i - U2\' (t) < e2^'(^"*)E[ J va\Ui - U2\%s)ds < J vi{E \Ur - U2\\s)ds. 

t t 

Then, by Bihari's inequality, for all t, E \Ui{t) — U2{t)\^ = a.s., implying also that Ui = U2 
a.s. and consequently Ai = A2 a.s.. By transforming back to {Y,Z), the result follows. 
The proof is similar when the assumption (v) of Condition 1 is replaced with the alternate 
condition (v)'. In that case, for < 7 < 1, we again apply the inequality 2 \ab\ < ^c? + 6^/7 
to 2(Ai — A2)h{Ui — U2) but instead with the parameters a = (Ai — A2) and b = h{Ui — U2); 
combine the resulting integrals with the terms of ^ and finally apply the Bihari's and 
Jensen's inequahties (without an appeal to the Gronwall's inequality) to get the result. ■ 

Remark 3 (a) Some examples for the function X, satisfying the condition (iv) of the The- 
orem, are given below: 

(i) Let Xi{t,u) = a{t)u^, where a{.) is a (positive) continuous function and < r < . The 
corresponding concave function n = Ki in ^ is actually given by ^ of Lemma [H' Ki (x) = 
K,''''^{x) for some < e < e~'^ . Note that \i(t,u) is also concave in u. 

(ii) Let X2{t,u) = e~^^*^^, where (3 : [0, 1] — )■ [0, 00) is a continuous function. Here, A2(t, .) is 
a convex function and the corresponding concave function in ^ is K2{x) = x. 

(Hi) Consider X3{t,u) = Xi{t,u) + X2it,u), as a sum of a concave and a convex function. 
Now, the corresponding k^^.) would be taken as + K2{.) or max(/ti(.), K2(.)). 
(iv) Yet another example where the function X is super-linear in u is X4^{t,u) = Culn{u~^) 
and K,4,{.) = Cu\n{u~^) ln(ln(u~^). The reader is encouraged to find other interesting exam- 
ples. 

(b) The existence of a (global) solution under the assumptions of the Theorem\^ (even with a 
bounded terminal condition and time-homogenous parameters) is not guaranteed in general. 
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Briand et. al (2007) provides an example where an exponential moment condition on the 
driver is violated. Similarly, the generalizations of the existence-uniqueness results for the 
BSDEs with linear growth in z (see e.g. Fan and Jiang, 2010 and the references there) are 
not directly applicable to the transformed BSDE ^ due to the conditions on the functions 
f{t, x) and X{t, u). 

(c) One can perhaps try a combination of the standard localization methods and the Picard 
iterations (which also appeared in some of the papers cited earlier) directly to the original 
BSDE noj) or to ^ for the existence part. However, it is not the direction we follow in this 
work. Instead, we will exploit their connections with PDEs of the form in the next 

section by also providing an application to a stochastic optimal control problem. 



3. The PDE and FBSDE Representations 

In this section, our aim is to show the connections between the solution (F, Z) of the Marko- 
vian FBSDE system ([T]) and that of the quasihnear PDEs of the form (l3])-(j4]). Note that we 
haven't assumed any conditions on the drift and diffusion parameters of the forward process 
X so far (hence the PDE may be degenerate). Moreover, the conditions that we imposed 
on the driver and the terminal condition are more general than the standard regularity and 
growth conditions (e.g. Lipshitz condition, boundedness of the derivatives of the coefficients, 
linear growth etc.) for nonlinear PDEs to ensure the existence of a smooth solution to the 
PDE (I3])-(I4]). So we may only expect to have a generalized solution (e.g. a viscosity solution) 
to such a PDE. 



3.1 PDE Characterization of the Problem 

By a heuristic application of the seminal result of Pardoux and Peng (1992) and the setup 
above, if a function V{t, x) is a smooth solution to the equation (|3]), then the pair (y/'"^, Z^'^) 
with Yt = V{t,Xt) and Zf = a{t, Xt)Vx{t, Xf) can be shown to be a solution to the BSDE 

dY^s,. ^ -F{t,Xt,Yt,Zt)dt + ZtdWt (10) 



with 



t t 

Xt = Xt"" = ^ + / t^it.Kldr + j a(r,X;'")rfVr„ 



and F(t, x, z) as in 



Remark 4 (a) The representation of fTd\) - l[Il\} as a FBSDE system is not unique. Another 
representation may be given by the following system, by eliminating the drift term of the 
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forward process: 

X"'^ = x + I a{r,Xr)dWr (12) 



1 1 

F/'" = g{XT) + j F{r,Xr,Zr)dr- j Z, 



rdWr 



where the new driver function is F(t, x,y, z) = F(t, x,y, z) + ^^^^z (as long as the Girsanov's 
theorem applies). Each representation has some advantages depending on the complexity level 
of the forward and backward equations in [TD^ - U^) . In this section, the representation [TP) 
will he used frequently based on the assumption that the forward state dynamics 07]) has a 
unique solution. 

(b) The existence-uniqueness of the solutions to a particular form of [T^) was shown in 
Cetin (2005, section 2.2), thanks to its stochastic control interpretation as a solution to the 
standard LQR problems. 

Corollary 5 Consider the assumptions of the Theorem\^ and let F{t,x,y, z) be given by 
gp. IfV{t,x) e Ci'2([0,T] X M) satisfies the PDF ^, then we have vlt,x) = F/'^ = 
for all {t,x) G [0,T) x M, where the pair (F/'^, Z^^'^) given by Y{t) = V{t,Xt) and Z{t) = 
a{t, Xt)Vx{t, Xt) solves the system / [70j) -/ l77]) uniquely. Moreover, V is the unique solution of 
the PDF. 

Proof. If V{t, x) is a classical solution to the PDE ([3]), then define (F/'^, Z^'^) depending 
on X^'^ deterministically as Yf = V{t,Xt) and Zf = a{t,Xt)Vx(t,Xt). Applying Ito's rule to 
Yt = V{t,Xt), and by (E]) and (E]), we get 

dY = lV{t,X)dt + a{t,X)V^{t,X)dW 

= -Fit, X, Vit, X), ait, X)K-(t, X))dt + ait, X)K(t, X)dW 
= -Fit,X,Y,Z)dt + ZdW. 

So, by the uniqueness of the solutions to l[W\) from Theorem [21, the result easily follows. ■ 

Remark 6 The converse of the Corollary is also true in the sense that if the triple 
iX^'^ ,Y^'^ , Z^'^) solves the system / [70j) -/ l77]) and possess some stability and path regular- 
ity properties, then the deterministic function Vit, x) defined as Vit, x) = F/'^ is a viscosity 
solution of the PDE Such a result is given by Briand and Hu (2008). The uniqueness 
may require some extra monotonicity conditions on Fi.,.,y,.). We stay working with the 
smooth solutions in this work. 

3.2. A Stochastic Control Application 

Now consider the following controlled state dynamics Xt = X^ with a control-dependent 
drift term: 

dXt = ifiit,Xt) + Bit,Xt)ut)dt + ait,Xt)dWit), (13) 
Xq = xo > 
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where fi,a,B : [0, T] x M — )■ M are contiuous and u belongs to the control space U of square 
integrable real- valued adapted processes such that the equation (fT3|) also has a strong solution 
e L|,. Let the cost functional be given by 

T 

x) = E,,,. J [{Xt - + hity,)]dt + k2{XT - my (14) 

where ki{.) > 0, k2 > 0, and ^(t) is a continuous function, describing the target for the 
state process Xt = Xf to approach or stay close. Define the value function as V{s, x) = 
inf^ J^{s, x) which is finite since both ki{t)u'f and k2{XT — ^{T))"^ are bounded from below. 
This formulation resembles the stochastic LQR problems except that here the functions fi 
and a need not be linear in x, and B(t, x) may also depend on x. Assuming that the SDE ( fT3l) 
has a solution for a sufficiently rich set of the control processes in U, and the optimization 
problem (HM is solvable, we can identify a corresponding FBSDE system to characterize the 
solution and solve it numerically. 

By a formal application of the dynamic programming principle (DPP) of the standard 
stochastic control theory (as in Fleming and Soner, 2006), the value function should satisfy 
the HJB equation 

Vtit,x) + la\^^{t,x)+M{{x-^it)f + kiit)u^ + v^it,x){ix{t,x) + B{t,x)u)} = (15) 

Z u 

k2{x~mf = viT,x) 

where the infimum of the (Hamiltonian) expression {x — ^(t))^ + ki{t)u^ + Vx{t, x){fi{t, x) + 
B{t,x)u) is obtained with u*{t,x) = — ^2ki{t) '' ■ writing this candidate optimal control in 
the equation (IT^ . we obtain a quasihnear PDE of the form ([3]), given by (fTB]l below, with 
F{t,x,y,z) = {x-^{t)f -lH{t,x)z'^, where H{t,x) = 2^7(7) (flrfy)^- Note that the function 
F is independent of and H{t,x) may depend on x. In general, a classical solution to the 
equation ( fTSj) is not guaranteed to exist. However if H{t, x) = H(t), and if a smooth solution 
to the corresponding HJB PDE ( lT6l) exists, then the results of the previous section apply 
and we have the following result: 

Theorem 7 In the setting above, suppose that H{t,x) is time- dependent only: H{t,x) = 
H(t) and F{t,x,y,z) = (x - ^{t)f - ^H{t)z^. Assume that for all p > 2, the SDE 

has a unique square integrable solution X" G Sp, for u = and u = u* = — -^^^^^ where 
v{t,x) G C"'^'^[0,T] X R satisfies the quasilinear PDE 

'^t{t, x) + ]^a'^Vxx{t, x) + F(t, x, V, avx) = 0, v{T, x) = k2{x - i{T)f . (16) 

Moreover, let Xt denote the solution to the SDE [W\) for m = 0. Then, 

(i) The pair {Y^'^ , Zl'^) with Yt = v{t,Xt) and Zt = cr{t)vx{t, Xt) is a (unique) continuous 
solution to the BSDE 

■^It would depend on y linearly, if we considered a time-discounted cost function. 
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in in Sp^ x such that Y is bounded from below. 

(a) The value function is given by v{t,x) which is the unique smooth solution of the PDF 
( fl^) and satisfies v{t, x) = Y^'^ , for x G M and t G [0, T) . 



Proof. The part (i) directly follows from Theorem O representations ( fTOl) - (fTT]l and 
Corollary [5l When u* is an admissible control and value function is well-defined (finite), 
part (ii) is a result of Corollary [5] and the arguments of the stochastic control theory for the 
classical solutions of the HJB equations. ■ 

Remark 8 (a) Ideally, an applicable "verification" theorem for the control problem or some 
a priory bounds for the processes X,Y and Z would be needed (since we haven't assumed 
any Lipshitz or growth conditions on the SDE / f73]) explicitly) to get part (ii) of Theorem. In 
most cases, the value function will be a viscosity solution to the PDF by a "formal" appeal 
to a version of the DPP, if available. 

(b) Under the Lipshitz conditions on n and a and a boundedness assumption on a, Fuhrman 
et. al (2006) showed that the value function is given by the maximal solution of the BSDE 



(11), using some localization arguments. They also provide the LQR example as a special 
case and consider more general applications where the control set is constrained to take 
values from a closed set o/ M. The uniqueness to the solutions of the BSDEs (and hence 
the corresponding PDEs) related to the LQR problems was also reported in Cetin (2005), by 
exploiting the regularity properties of the explicit solution for the value function. 

Example 9 Consider the following perturbed version of the LQR problem: 

dXt = {A{t)Xt-6X'^ + B{t)ut)dt + a{t)dW{t), (18) 
Xq = xo > 

where the time dependent functions A, B and a are continuous, B and a are bounded away 
from zero on the interval [0,T], and u belongs to the control space lA as before. The term 5 
is a small perturbation constant, so the system reduces to a linear one with Lipshitz coeffi- 
cients when 5 = 0. Even though the standard (unperturbed) LQR problems have an explicit 
quadratic form as a solution, this perturbed version of the problem cannot be solved explicitly. 
Using the same arguments above, the corresponding HJB equation is given by 

vt{t, x) + la\t)v:,:,{t, x) + mf{{x - ^{t) f + ki{t)u'^ + v^{t, x){A{t)x - 6x^ + B{t)u) = (19) 

with v{T,x) = k2{x — ^(T))^. When the terminal condition is bounded (e.g. when k2 = 0, 
as in Tsai, 1978), using the methods of the parabolic PDEs, it can be shown to have a 
smooth solution. For more general functions, even when the PDE is uniformly parabolic, 
the existence of a classical solution is not guaranteed in general. To prove that the equa- 
tion l[TE\) also has a square integrable solution X"* corresponding to the (feedback) control 
u*(t) = —■^{t)vx{t,X{t)), we may need some a priory estimates on the (potentially viscosity) 
solutions of ^2^). However, if the solution is smooth, the uniqueness follows from Corollary 

m 
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Theorem 10 Consider the perturbed state dynamics [W\) together with the cost function 
( [7^ and the value function V^{s,x). Then 

(i) The value function V{s,x) is the unique smooth solution to the HJB PDF 

vt + ^a^{t)v,, + {x-^it)f -{Ait)x-5x')v,-^Cit)vl = (20) 

v{T,x) = 

where C{t) = {B^/2h){t) over [0,T]. 

(a) Let H{t) = satisfy the assumption of Condition 1 (i). Then the triple (X*'^, F/'"^, Z^'^) 
with Yt = V{t,Xt) and Zt = a{t)Vx{t, Xt) is a (unique) solution to the FBSDE system 

^Y^S,X ^ ^^^^^ ^ ^^^^^^ yS,X ^ Q ^21) 

t t 
Xr = X- j {AXr - 5Xl)dr + j a{r)dWr, 

s s 

where F{t,x,z) = {x - p{t)f - Moreover, V{t,x) = Yt'"", for {t,x) G [0,r) x M. 

Proof. For part (i), note that the derivative of the function fi{x) = Ax — 6x^ is bounded 
above and xfi{x) can be bounded from above by a — (3x^, for some positive constants a and 
p. So using the Lyapunov conditions for locally Lipshitz parameters, the forward SDE in 
(|2T|) can be shown to have a unique global solution X G Sp, for all p > 1. By the relevant 
DPP results for bounded terminal value problems, if the value function V{t, x) is sufficiently 
smooth, then it should satisfy the HJB PDE fl20l) together with the candidate optimal control 
u*. Since the time dependent parameters are (uniformly) continuous on [0,r], by following 
the similar steps as in Tsai (1978), one can show the existence of a smooth solution v(t,x) 
to the PDE ( 120|) . too. Then by Theorem [21 representations (|TOl)-f|TT]) and the Corollary 
O the BSDE in ( pT]) has a unique solution (Y, Z) such that v{t,x) = Y-l'^ = V{t,x) and 
a{t)V{t, X{t)) = Z(t). Alternatively, it can be inferred from an applicable verification 
theorem, e.g. as in Tsai (1978) or Fleming and Soner (2006). ■ 

Remark 11 Such FBSDE representations would he very helpful to solve these type of non- 
linear PDFs (and control problems) numerically, especially in higher dimensional cases. It is 
especially useful if the nature of the PDF solution is not known explicitly and can be inferred 
from the properties of the numerical solution to the corresponding FBSDF system. We leave 
the discussion of the numerical solutions and their stability /convergence properties to some 
subsequent work, including Cetin (2012). 



References 

[1] Bihari, I. (1956). A generalization of a lemma of Bellman and its application to unique- 
ness problem of differential equations. Acta Math. Acad. Sci. Hungar. 7, 71-94 

[2] Briand, P., Lepeltier, J-P, and San Martin, J. (2007). One-dimensional backward 
stochastic differential equations whose coefficient is monotonic in y and non-Lipschitz 
in z, Bernoulli 13 (1), 80-91 



12 



[3] Briand, P., Hu, Y. (2006). BSDEs with quadratic growth and unbounded terminal value, 
Prob. Theory Related Fields 136, 604-618 

[4] Briand, P., Hu, Y. (2008). Quadratic BSDEs with convex generators and unbounded 
terminal value, Prob. Theory Related Fields 141, 543-567 

[5] Cetin, C. (2005). Backward stochastic differential equations with quadratic growth and 
their apphcations. Ph.D. Dissertation, USC. 

[6] Cetin, C (2012). A forward-backward numerical scheme for the perturbed hnear- 
quadratic regular problems, preprint. 

[7] El Karoui, N., Peng, S., Quenez, M. C. (1997). Backward stochastic differential equa- 
tions in finance. Math. Finance 7 1-71 

[8] Fan, S. and Jiang, L. (2010). Finite and infinite time interval BSDEs with non-Lipshitz 
coefficients. Statist Probab. Lett. 80 962-968. 

[9] Fleming, W.H. and Soner, H.M. (2006). Controlled Markov Processes and Viscosity 
Solutions, Springer- Verlag, Second Edition. 

[10] Fuhrman, M., Hu, Y. and Tessitorc, G. (2006). On a class of stochastic optimal control 
problems related to BSDEs with quadratic growth. SIAM J. Control Optim., 45, 1279- 
1296 

[11] Kobylanski, M (2000). Backward stochastic differential equations and partial differential 
equations with quadratic growth. The Annals of Prob. 28 558-602 

[12] Lepeltier, J. P. and San Martin, J. (1997). Backward stochastic differential equations 
with continuous coefficients. Statist Probab. Lett. 32 425-430 

[13] Lepeltier, J. P. and San Martin, J. (1998). Existence for BSDE with superlinear- 
quadratic coefficient. Stochastics Stochastic Rep. 63 227-240 

[14] Ma, J., and Yong, J. (1999). Forward-Backward Stochastic Differential Equations and 
Their Apphcations, Lecture Notes in Math, 1702, Springer 

[15] Mao, X. (1995). Adapted solution of backward stochastic differential equations with 
non-Lipshitz coefficients. Stock. Process. Appl. 58 281-292 

[16] Pardoux, E. and Peng, S. (1990). Adapted solution of a backward stochastic differential 
equation. Systems Control Lett. 14 55-61 

[17] Pardoux, E. and Peng, S. (1992). Backward stochastic differential equations and quasi- 
linear partial differential equations. Lecture Notes in CIS, vol. 176 Springer, 200-217 

[18] Pardoux, E. and Peng, S. (1994). Some backward stochastic differential equations with 
non-Lipshitz coefficients, Prepublication LATP, 94-03 



13 



[19] Peng, S. (1992). Stochastic Hamilton-Bellman equations, SIAM J. Control Optim., 30, 
284-304 

[20] Richou, A. (2011). Markovian quadratic and superquadratic BSDEs with an unbounded 
terminal condition. Preprint, arXiv: 1111.5135 

[21] Tsai, C-P. (1978). Perturbed stochastic hnear regulator problems, SIAM J. Control 
Optim., 16, 396-410. 

[22] Yong, J. and Zhou, X.Y. (1999). Stochastic Controls: Hamiltonian Systems and HJB 
Equations, Springer- Verlag, New York 



14 



